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The Multi-Digit (MDT) testing procedure is a 
computer-scored testing innovation conceptualized in 1982. It is 
fully compatible with multiple choice and true/false tests well 
suited for the testing of discreet terms and concepts such as in 
f ill-in-the-blank examinations. The student reads the question and 
selects the appropriate response from an alphabetically organized, 
lengthy list on which each term is numbered. With three-digit 
nujnbers, there can be up to 999 items on a list, far too many for any 
student to peruse in an attempt to recognise the correct answer. The 
student is required to recall the correct answer, locate it on the 
alphabetical list and then place the code nxmiber on the computer 
readable answer sheet. The paper explains how to use MDT in teaching 
and evaluating an Introduction to Criminal Justice course. A sample 
MDT test and actual MDT lists for major clinical justice terms and 
concepts are appended. (Author/JAZ) 
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ABSTRACT 

The Multi-Digit (MDT) testing procedure is a ne^v addition to 
computer scored testing and is fully cxDnpatilDle with multiple 
choice and true/false tests. It is especially well suited' for 
tlie testing of discreet terms and concepts such as in fill-in-the 
blank examinations. The student reads the question and selects 
tne appropriate response from an alphabetically organized, 
lengtiiy list on which each term is nuiiiuered. With three-digit 
numloers, thiere can be up to 999 items on a list, far too many for 
any student to peruse in an attempt to recognize the correct 
ans;ver.^ The student is required to recall the correct ans^/er, 
locate it on the alphabetical list and then place the code number 
on the computer readable anstver sheet. Actual MDT lists for 
raj or Criminal Justice terms and concepts are provided in this 
paE:>er \^xdti also ea^lains how to put the Multi-Digit testing 
innovation into iminediate practical use for the teaching of the 
Introduction to Criminal Justice courses on any campus. 
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ItJERODUCTION 

Teacliing a course on tlie Introduction to Criminal Justice ScL 
requires a variety of evaluation tecJiniques in order to assess the 
students' learning in the various components of that course. The 
iiigher order forms of learning which require synthesis and 
evaluation by the students are traditionally tested with essay 
tests or single paragraph answers. Important as that element of 
testing is, essays are not the best method for determining if tlie 
students have roastered the basic factual information v;hich is 
essential for anyone to have a firm grasp on tlie topic of 
Criminal Justice Sciences. To determine that kno;>rledge professors 
commonly utilize multiple choice or fill-in-the-blank tests. 
Tlie multiple choice method has the obvious disadvantage of 
encouraging recognition , the elimination of alternatives, and 
outright guessing. It is hard tp imagine that someone would not 
pick out the term frait a selection of five names. Furthermore, 
the onus is on the professor to devise the four \7r0nq ans^vers 
(foils) that are supposed to have a reasonable likelihood of 
being selected if the student does not recognize the correct 
ansv;er. The result is that students frequently avoid the full 
learning of essential factual infornation in a course, 'A'hether 
introductory or at an advanced level, because they are good 
at recogni.tion and the elimination of foils. 

• It is much more difficult to recall from memory and write 
dov.TL specific ansi^ers. Recall requires that the information be 
learned better; Therefore, considering that some of that factual 
information should become part of the basic Jmoivledge of an 
educated person, professors sometimes opt for tests \^ere one or 



two v;ord ans;7ers must be ivritten. The questions are actually 
easier to \7rite than those of a multiple choice test becaiose no 
alternative ansv;ers are required. The major difficulty with such 
fill-in-the-blanlc style tests is that the professor must be 
willing to devote significant time to their grading, especially 
if mastery learning is desired. Wliat would useful is a 
computer scored fill-in-the-blank style test of terms and 
concepts about Criminal Justice Sciences that could be quickly 
exonerated and graded, complete with statistical analyses. Then 
tJie essential learning can be required and tested v*iile freeing 
tlie professor for essay scoring,, student advisement, research and 
other activities more productive than mcinual test scoring. 

The Multi-Digit (MDT) testing innovation is a computer scored 
approximation of a fill-in-the-blank test. It is ideally s'oited 
for the evaluation (and stimulation) of learning of the factual 
information essential to a course such as the Introduction to 
Criminal Justice Sciences. Not only does it make tl::e test 
scoring faster, it also makes the formulation of the test 
questions extremely easy and, according to recent research 
discussed in the next section, contributes to improved student 
learning during the semester and greater retention even after 
the conclusion of the course. With fast computer scoring of 
quickly generated tests which require student recall rather than 
recognition, a professor can more easily specify the level of 
competence required from the students. In that way, any student 
\<i\o does not meet that minimum requirement can be given 
additional tests until that requirement is met. The [4DT 
materials included in the appendix of this paper permit such a 
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learning rec]uiren«ent to be specified by the professor in a course 
on Criminal Justice Sciences. 

The Multi-Digit method requires the student to select the 
desired answer fron very long lists of alternative responsess. 
In the answer sheet format shown in the appendix, the three-digit 
responses mean that up to 999 alternative answers can be on a 
single list. (Two-digit and four-digit versions are being deve- 
loped.) Those lists of responses need only be prepared once or 
maybe revised at the beginning of each course • In the case of • 
Introduction to Criminal Justice Sciences, the initial long lists 
tiiat could be used by any professor are provided in the 
appendices of this paper; they are sufficient for literally 
tliousands of questions. In other words, there is no need for the 
professor to be concerned with the incorrect alternative answers 
if the correct t^irm for a given question is found on one of the 
lists. There are many ways of phrasing questions viiich ^vould 
utilize these long lists of answers. Furtliermore, the MDT 
innovation v/ill accorDOdate numeric ansi>;ers of three digits. 

BACKGROUND AND RESEARCH 

The miti-Digit long list testing method was first 
conceptualized in the fall of 1982 by Dr. Anderson, co-author of 
tliis paper. It lias subsequently been used for seven consecutive 
semesters with over 700 studerits in a course on Wbrld Regional 
Geography. It is currently being used in the discipline!: of home 
economics, art appreciation, mcitheiratics, history, military 
science, English, political science, earth science, computer 
programming and chemistry. Instructors have created lists for 



their subject matter and have lased it in the classroom with 
several thousand university students. In addition, the largest 
single course to use the rrat±iod has 1200 criminal justice 
students this senraster, under the coordination of Diane 
Alexander, a co-author of this paper. 

Because of the almost complete elimination of guessing on 
the Multi-Digit method in comparison to traditional multiple choice 
tests, the students' scores may be generally lower on an MDT 
test. There may also be a wider spread -from the very Iwest 
score to tlie highest score attained by students. Both of those 
characteristics can be advantageous to the professor. The 
traditionally accepted percentages of 90% and above being an A 
should not be applied to the MDT testing situations unless 
tiie professor intentionally modifies the examination material so 
tiiat thiere are sufficient easy questions to allow the attainment 
of the specified percentages. In all cases, the individual 
professor remains independent and in charge of his or her 
particular class. 

One of the key questions in evaluating this ne^^r testing 
technique concerris whether the students learned and retained more 
tlian they would have if studying for a traditional multiple 
choice test. Exploratory research conducted by Anderson, Flill, 
Nairn and Walters (1985a) with nearly 200 students enrolled in 
V7orld Geography, revealed that students v*io study for a fill-in- 
the-blank test or a Multi-Digit long list test retain more of 
their learning at the end of the semester than do students who 
studied the same naterial for a multiple choice test with five 



alternative answers. These results are exactly as hypothesized, 
Purthenrore, v/hen students gain more familiarity with the mdt 
nietiiod, tlieir results are expected to become even more similar to 
tlie greater learning and retention of the fill-in-the-blank method. 

I'IDT Test Construction 

Lists of terms preferably for the entire course should be 
constructed prior to the first test using the MDT format. The 
lists (see appendix) can be divided into different subject areas 
such as terms and concepts, names, amendments, places, court 
cases, professional organizations and agencies. The subject 
areas v/ith fe^ terms should be grouped together to increase the 
requirement of recall and reduce recognition. All of these lists 
could be combined into one. Sanple lists for textbooks by Cole 
and Inciardi are attached to this paper. 

Terms for the lists may be pooled from numerous sources, 
including glossaries and indexes. Terms from personal notes 
should also be included to cover specific lecture material. As a 
final resource, student study guides and instructor's manuals 
usually list key terms and concepts. 

Test questions using responses on the MDT list need to be 
constructed \7ith some caution. Questions should not have 
multiple possible ans\>;ers on the list. An exanple, if the terms 
law enforcement and police are both on tlie list, there could be 
t.vo correct answers for hastily prepared questions. The 
development of questions also involves a consciousness of the 
tirre required to answer the test because of the extra sheet of 
paper plus rrore marks to fill in. Students generally take 
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slightly longer to answer this style of questions. However # fewer 
questions are needed because of the increased academic rigor of 
recall. A short demonstration test early in tlie semester will 
provide tlie students v;ith an in-depth understanding of the I>4DT 
answer fonrat metlia" alleviate "test anxiety" and mental 
blocks caused by tlie ^^--^ATiess of the testing procedure. 
The pre-test also is an indicator to tlie students of the 
increased arrount of studying time required to prepare for this 
test procedure. 

Test Results 

Computer programs for the grading of MDT tests provide sub- 
total scores for groups of questions and for each style of scores 
to be prepared on lx)th tiie tests using MDT lists and any other 
format questions (ie: essay, MDT long list, multiple choice and 
true/false). This allows for the student to compare results and 
also detect wealcnesses in study liabits. Further computer 
generated results also indicate to the student their actual word 
answers as well as the correct "answers because each term is in 
the computer under its code number. This feature helps tlie 
students clarify any misconceptions of the definitions or usage 
of description terms or concepts. Further explanations of the 
MDT method £ire in the book The MDT Educational Innovation 
(Anderson, 1935) . 

Conclusions 

The use of KiDT in Criminal Justice Sciences can be rev^arding 
to tiie instructor as well as the student. In introductory 
courses, such as the one at ISU, this testing format reduces 
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chearingr facilitates question generation (although the lists can 
stay tlie same) so that tests Ccin easily be changed from term to 
terrr./ and provides an outlet for in-depth testing to instructors 
iii both large lecture halls and small classrooms. Approximatley 
1500 Introduction to Criminal Justice Sciences Courses students 
nave taken the test and admitted it is harder but it encourages 
better study skills and negates "all-nighters" performed the day 
before tlie test. There has been a substantial increase in the 
number of students taking advantage of seminars, small groups and 
test reviev/ since the change to this form of testing. 

At Illinois State University, the students and faculty have 
foiand positive results from this testing, not only in the area of 
Criminal Justice but also in other disciplines. Upper 
level courses as well as introductory courses are able to provide 
the student with the educational benefits of a fill-in-the-blank 
test v/itiiout the time of manual grading. 

********************************Hf ******* 

NOTE: The Multi-Digit Technologies (MDT) Corporation offers 
start-up assistance to any instructor wanting to use tlie MDT 
innovations. For further information , telephone 309-452-7072 or 
vjrite to P.O. Box 14, Normal, Illinois 61761. MDT and Multi- 
Digit are trademarks of the MDT Corporation. 




Demonstration M.D.T. Test 
[Use Cole List] 

Terms & Concepts 

1. Defendants ^>?ho are awaiting trial/sentencing or serving a period of 
irnprisonjrent not to exceed one year are housed in (203) . 



2. The individuals in Normal isSio have the paver to arrest, ride around in 
cars with lights and sirens and \'^ar a badge. and gun are referred to as 
tlie Normal (256) Department. 

3. Hinckley was relieved of his criminal responsibility for attempting to 
assassinate Ronald Reagan because of his accepted plea of (197) 



4. There are two categories of crimes, misdemeanor and (175) 



5. The T.V. show, "The People's Court" involves inforital processing of cases 
decided by a retired (204) 



6. Miami (320) is a top-rated T.V. program which involves a realistic 
(ha! ha!) portrayal of detective work. 

Names 

7. The individual v*io researched the effectiveness of treatment programs 
and rehabilitation efforts and concluded with "nothing works" is 

(5fi6) . 



Amendnents /Court Cases/Organizations/Places 
8. This court has eight males and one female on it (782) 



9. The state wliich borders Illinois and is \*iere the baseball team 'The 
St. Louis Cardinals" is from is (755) . 



10. The freedom of religion, freedom of speech and the right to assem!:>le are 
riclits given to us in the Constitution under the (704) amc.^nd.Th3nt. 
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CXDLE: Sample Questions 



1. The large amount of plea bargaining vAiicii makes our court system similar to 
tii?.t of a revolving door, and the impersonality existing in soir.r- part of 
the criminal justice system has led to our system of justice being referred 
to as one of (108) justice. 

2. The diief law enforcement officers of a- county are termed (298) . 

3. The formalized definitions of offenses v/hich specify all their 
characteristics is referred to (308) lav/. 

4. Naire the primary individual vdio believed tliat physical attrilDUtes and heredity were i 
for causing criminal behavior (561) . 



5. With few exceptions, police officers need a search warrant to search your 
house because of the rights granted by the (706) amendment. 



IKCIAPJDI: Sample Questions 

1, Liability imposed on an employer for certain illegal acts of his employees 
committed during their anployment is named (228) . 



2. The administrative record of an arrest is the (21) stage of the 
criminal justice process. 

3. (34) involves legal action of one individual against anotlier 
individual and is structured to regulate the rights between individuals or 
organizations. 

4. The federal agency created to lead the "v/ar on crime" and was a provision 
of tlie Qmibus Crime Control and Safe Streets Act is (139) . 



5. In tlie court case (329) , the United States Supreme Court reversed 

a lower court decision on the grounds that offenses such as "being addicted 
to the use of narcotic^" v;ere unconstitutional and that imprisonment for 
such an offense was cruel and unusual punishment in violation of the Eighth 
Arr;andment. 
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(COLE) MDT LISTS for CRIMINAL JUSTICE 



TERMS & CONCEPTS 



A 101 
102 
103 
104 
105 
106 
107 
108 
109 
1X0 

Bin 
112 
lU 

U4 

115 
116 
117 
52 118 
119 
120 
121 
122 
123 
124 
125 
126 
127 
128 
129 
130 
131 
132 

133 
134 
135 
13S 
137 
138 

139 
140 
141 
142 
143 
144 
145 
146 
X47 

148 

D149 
150 
151 
152 
153 
154 
155 
156 
157 

158 
159 
160 
161 
162 
163 
164 

E165 
166 
167 
168 
169 

F170 
171 
172 
173 
174 
175 
176 



Actual •ofoccwoot 
Actua EQua 
Adjudlcatioo 
Appeals 

Apprtiienaioa procoaa 

ArralgnatAt 

Arroat 

Asifaably-lina joatics 
Aoai9nad counaol 
Auburn avatca 
Bail 

BUI of ftighta 
Biopaycbological 
axpl4nationa 
Black judgaa 
Blua^Coat ctiaa 
Bondaaan 
Buraaucracy 
Capital puniahnant 
Casa law 

Challanga for cauaa 
Child savers 
CI aaeif icatlon 
Clearance rate 
Coda of aecrecy 
Collective bargaining 
Cooaon latf 

COBSunity corrections 
Concensus soda! 
Conceptual fraasiiork 
Concurrence 
Conflict Bodel 
Conetitutional 
protectiona 
Copping out 
Correctioos 
County 
Court 

Courtrooa workgroup 
Courts of general 
jurisdiction . 
Crina 

Crina control model 
Crime rate 

Criminal justice syetaa 
Criminal reeponsibllity 
Criminal aanctioa 
Criminogenic 
Criticsl criminology 
Cruel and unuausl 

punishment 
Custodial model 
Deadly force 
Death penal tr/ 
Defenas attornay 
Osi nati tutionaliaatioa 
Delinquent 
Detention 

Determinate aentences 
Deterrenosj 

DiffarenticU ^aasoclation 

theory 
Discovery 
Discretion 
Diver aion 
Double jeopardy 
Dusl court sy*tea 
Due proceae 
Durham Rule 
Eighth Aaendaent 
Engliah police tradition 
Bxchangs relationships 
Bxchange tystca 
Eaciuaionary rule 
Factual guilt 
Pederal 

Federal courte 
Federal prlaon syatea 
Federal iaa 
Fal ony 

Female corrections 



H 

I 



177 resale crlSinale 

178 Field interrogatica 

179 Filtsring process 
VOO Full enfoffceaent 
181 Fuodaaentsl fairness 
183 Furloughs 

183 General dstesrenca 

184 Good tins 

185 Grand jury 

186 Grass eetere 

187 BoBicide 

188 Buber Act 

189 ZncapBoitstioa 

190 Xocacceration 

191 Xndeteninate aentences 

192 Index crimee 

193 Indictment 

194 Information 

195 Initial appearance 

196 Inmate code 

197 Inaanity 

198 Intake 

199 Internal affairs unit 

200 Interrogation 

201 investigstioa 

202 Irresistible Xapolss Test 

J 203 JaUs 

204 Judos 

205 Judicial selection 

206 JurisdlotlQii 

207 Jury 

208 Jury asleetioa 

209 Jury trial 

210 Juvenile corrections 

211 Juvenile court 

212 Juvenile crime 

213 Juvenile justice 

1^ 214 Kansas City Response Time 
^ Anslysis Study 

215 Labeling theory 

I 216 Latf Enforcement Bducatfion 
Program (LUP) 

217 Lm enforceaefit 

218 Legal guilt 

219 Legal eufficiency 

220 Legalistic style 

221 Legislative procass 

222 Local 

223 Lov visibUity 
|IA224 N'Naghten Rule 

225 Hala in ss 

226 Hola probibiU 

227 Mandatory . aentences 

228 ttoat eater e 

229 Mene rea 

230 Minority police officere 

231 Hiedsaeanor 

232 Hieaouri nerit 

Selection Flan 

233 Harder 

W 234 itaoosssrUy included 
offenses 

235 neglected chUd 

236 Nolle prosoqoi 

237 Nolo contendere 

238 Nonpartisan election 

Q 239 Oanibue Crime Control and 
Sa£e Strests Act 

240 Order aaintanance 

241 Organised cciae 

242 Overeriainalisation 
Q 24S PXHS/CINS/JZHS 

244 Parens patriae 

245 Fsrole 

246 Parole officer 

247 Partissn slaction 

248 patrol 

249 patrol function 

250 Penal code 

251 Penitentiary 

252 Penneylvania syataa 



253 
254 
255 
256 
257 
258 
259 
260 
261 
262 
263 
264 
265 
266 
267 
268 
269 
270 
271 
272 
273 
274 
275 
276 
277 
278 

R279 
280 
281 
282 
283 
284 

285 
286 
287 
.288 
209 
290 

292 
293 
294 
295 
296 
297 
298 
299 
300 
301 
302 
303 
304 
305 
306 
307 
308 
309 
T 310 
■ 311 
312 
313 
314 
31^ 
V.6 
317 
318 



u 



319 
\i 320 
321 
322 
323 
324 
325 
1A|32« 
"327 

328 
329 
330 



Penology 

Paraptory challenge 
Plea bargjiiolng 
Police 

Police brutality 
police interrogation 
Pel ice organisation 
Police voaen 
Political crinoe 
Preliainary hearing 
Preplea conference 
Presentence investigation 
Pretrial ditention 
Pretrial aotiona 
Pretrial proceaaee 
Preventive detention 
Preventive petrol 
Prisoners' rights 
Proactive 
Probation 

Procedural criainal law 
Procedural due proceee 
Prosecuting attorney 
Prostitution 
Public daf endsr 
Punishasat 

Rand Institute Study 
Reactive 
Reddivia 
Rehabilitation 
Reintegration aodel 
Relsaae on recognisance 
(RQA) 

Resource allocation 
Resource dependence 
Raetitution 
Retribution 
Revocation 
Right to counsel 
Searches and eeisuree 
Selsctive enforceneot 
Sentence Diaparity 
Sentencing council 
Sentencing guidelines 
Sentencing institute 
Sentencing review 
Sheriffe 

Sociological explanations 
Specifio deterrenca 
Stare decisis 
SUte corrections 
Ststus offenss 
Ststutee 

Structural theory 
Subcul ture 

Substantial Capacity Test 

Substantive criainal law 

Syetea efficisncy 

Teas policing 

Tbtal enf orceaent 

Traffic 

Trial 

Trial proceedings 
Trial eufficiency 
y.S« Constitution 
Ur^^ora Crime Reports 
Unreasonable searches 

and eeisures 
Oppsrvorld criae 
Vies 

Victialsstion surveye 
Vict ial ess 
Victiaology. 
Vieible criae 
Voir dira 
Wstchaan atyie 
White->collar criae 
Woaen priaonere 
Women* a prisons 
Work and educational 
release 
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NAMES 



A 


501 


Adl«r-Huall«r# Frada 


536 


502 




537 




503 




538 




504 


Auguttuflf Joba 


^ "9 


B 


505 


G 540 


506 


B&ldtflnr Jabss 


541 




507 


Ita 1 rf^i w - Lai a 


542 




500 




543 




509 


BackOTf HowArd 


544 




510 


BtfnfcbABr JcrflBy 


U 545 




511 


Blftcka Danald J. 


" S4f 




512 


BlAckr Hugo 
Brsl/r NaIcoIb 


547 




513 


1 94* 




514 


BranoftUr Hilliia 


J 949 




515 


CrocktfC^f latMiloQ 


^ 555 




516 


BuokXayr Jaaei if* 
Bugliosir Vinctne 


551 




517 


552 
^ 553 




518 


Bur gar r Mirran 




519 
520 


Cactacr Jlaay 
Cbaataisir wUliaa 


554 
*• 556 




521 


Clarkr Raaaay 




522 


Claar» Todd 


557 




523 


Craaaa/v Donald 


558 




524 


CrockatCr Gaorga W. 


559 




525 


Crofton, Sir Hal tar 


560 


D 


526 


Oarrovr Claranca Smard 


561 


527 


Davis, Banjaain M. 


ll/|562 
•"563 




528 


Daway» Thoaaa E* 




529 


Durkbaiflr Qaila 


564 


E 
F 


530 


Grikaonf Kai 


565 


531 


Parrlf Enrico 

Flalding, John and Uanry 


566 


532 


567 




533 


FogalBonr Robart 


568 




534 


Fordr Gerald a. 


|yS69 
570 




535 


Frankalr Jfanrin 



Frankfurter, Falls 
Fraud, Sigaund 
Friadr Josaph ?• 
9yt; Jaaaa 
Carofalo, BJiffaala 
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Diaordarly aaadaac 

OivaraioB 

Ooabla Jaapardy 

Oral ravolacioa 
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289 Sarroa v. Balcivora 
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308 Hole V. Sarvar 
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318 Marbary v. iladiaaaj 

319 McGaacba v. Califaraia 
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322 Micaada v. Ariaaaa 
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